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ABSTRACT 

Queueing  network  models  abound  in  applications,  but  despite  their 
importance  many  of  the  results  for  these  models,  both  classical  and  recent, 
are  not  well  known.  The  intent  of  this  paper  is  to  provide  an  overview  of 
available  results  on  the  equilibrlusi  analysis  of  networks  of  queues,  along 
with  the  methodology  which  has  been  employed  to  obtain  those  results.  In 
addition,  we  call  attention  to  some  important  open  problems.  Detailed  dis- 
cussion is  limited  to  a small  group  of  papers  which  seem  important  to  us, 
and  there  is  considerable  emphasis  on  recent  work  appearing  in  the  applied 
probability  literature.  The  list  of  references  does  include,  however,  work 
not  reviewed  here,  along  with  other  survey  and  background  material. 


1 .0  INTRODUCTION 
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Queueing  netvork  models  abound  in  applications,  appearing  in  such 
important  and  diverse  areas  as  coinmmications  networks  and  telatraffic,  com- 
puter tine-sharing  and  multiprograimning  systems,  maintenance  and  repair 
facilities,  production,  assembly  and  inspection  operations,  airtraffic  con- 
trol, and  medical  care  delivery  systems.  Despite  the  importance  of  queueing 
netvork  models,  however,  many  of  the  existing  results  for  these  models,  both 
classical  and  recent,  are  not  well  known.  In  this  paper  we  attempt  to  provide 
an  overview  of  the  available  results  on  the  equilibrium  analysis  of  networks 
of  queues  and  of  the  methods  which  have  been  used  to  obtain  those  results. 

In  addition,  we  call  attention  to  some  interesting  open  problems.  Our  dis- 
cussion is  confined  to  a rather  small  group  of  papers  which  seem  important 
to  us,  and  there  is  considerable  emphasis  on  recent  work  which  has  appeared 
in  the  applied  probability  literature.  The  list  of  references  does  include, 
however,  work  not  reviewed  here,  along  with  other  survey  and  background 
material. 

The  work  we  discuss  is  devoted,  almost  exclusively,  to  finding  the  equi- 
librium (or  limiting)  distribution  for  a network  of  queues  which  can  be  repre- 
sented as  a continuous  time  Harkov  chain  with  a countable  state  space  (cf.  [6] 
or  (TD*  The  results  which  have  been  derived  in  this  area  are  primarily  con- 
cerned with  the  Joint  equilibrium  distribution  of  the  customer  queue  sizes  at 
the  various  nodes  (or  service  centers)  and  with  the  nature  of  the  processes 
of  customer  departures  from  the  network  in  equilibrium.  For  a network  of 
queues  with  N nodes  and  M types  (or  classes)  customers,  the  equilibrium 
state  probabilities  (when  they  exist)  have  the  general  form  (cf.  [2]  and  [151) 
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7t(C)  » B ’ y{c) 

where  C = (c^,  c^,  . . . c^j)  and  is  the  configuration  of  customers  at 

node  i , where  y( * ) is  a function  of  the  number  of  customers  in  the  system, 

is  a function  that  depends  on  the  nature  of  node  1 , and  B is  a 

normalizing  constant.  In  the  simplest  case,  the  configuration  c^  may  repre- 

sent the  total  number  of  customers  at  node  i ; but,  in  other  instances  it 
may  also  involve  the  numbers  of  customers  of  different  types,  as  well  as  their 
arrangement  within  the  queue,  at  node  1 . For  open  networks,  that  is,  net- 

works of  queues  in  which  customers  originate  from  external  sources  and  each 
customer  eventually  leaves  the  system,  the  equilibrium  state  probabilities 
often  factor  into  terms  in  which  each  term  involves  only  the  parameters  for  a 
single  node;  in  such  cases,  for  example,  the  numbers  of  customers  at  the 
various  nodes  are  Independent  random  variables.  Also,  for  most  open  networks 
of  interest,  the  process  of  customer  departures  from  the  system  consists  of 
independent  Poisson  streams,  be  they  departures  of  customer  types  or  depar- 
tures from  tf.e  various  nodes. 

This  paper  is  organized  as  follows.  In  Section  2 we  present  a basic 
model  introduced  in  the  classical  paper  of  Jackson  (195T)«  This  basic  model 
is  used  to  provide  insight  into  problem  formulation,  into  standard  results 
for  equilibrium  distributions  and  equilibrium  departure  processes,  into  the 
important  technique  of  partial  balance  for  deriving  equilibrium  distributions, 
and  into  the  important  technique  of  time  reversal  for  studying  departure  pro- 
cesses in  equilibrium.  In  Section  2,  other  classical  work  following  the  paper 
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of  Jackson  (1957)  is  also  discussed,  including  the  papers  of  Jackson  (1965)> 
Gordon  and  Newell  (1997)>  snd  Posner  and  Bemholtz  (I968).  The  section  is 
closed  with  a review  of  some  of  the  limitations  of  this  classical  work.  In 
Section  3 we  discuss  the  careful  study  of  the  classical  model  of  Jackson 
(1957)  recently  put  forth  by  Beutler  et  al  ((5),  [^],  (30],  (51])*  Using 
results  from  [3],  we  derive  the  Laplace  transform  of  the  distribution  of  the 
total  time  spent  In  the  system  by  an  arbitrary  customer  under  equilibrium 
conditions  for  the  important  case  of  an  open  "acyclic  network,"  that  is,  an 
open  network  In  which  each  customer  can  visit  any  node  only  once.  In  Section 
3 we  also  discuss  the  recent  generalizations  of  the  models  of  Jackson  (1957) 
and  Gordon  and  Newell  (19^7)  which  have  been  developed  in  Kelly  (1975)/  Baskett 
et  al  (1975)/  and  Reiser  and  Kobayashl  (1975)*  In  Section  L we  discuss  the 
papers  of  Kelly  (I976)  and  Barbour  (1976)  which  expand  the  basic  models  of 
Jackson  (1957/  1963)  particularly  with  regard  to  routing  behavior.  Finally, 

In  Section  5 we  discuss  some  important  open  problems  in  the  equilibrium 
analysis  of  networks  of  queues. 

Other  surveys  on  the  subject  of  networks  of  queues,  and  the  related  areas 
of  computer  tiffle-sharing  and  multiprogramming  systems  and  computer-communica- 
tions networks,  Include  Disney  (1975)/  Vyszewlanskl  and  Disney  (1975)/  Kobayash 
(1976),  and  Kobayashl  and  Konheim  (1977)*  An  Introduction  to  the  subject  of 
networks  of  queues  Is  provided  by  Section  k.S  of  Klelnrock  (1975)  and  Section 
k.l2  of  Klelnrock  (1976).  Also,  Chapters  k and  5 of  Klelnrock  (I976)  provide 
comprehensive  discussions  on  the  subjects  of  computer  time-sharing  and  multi- 
access systems  and  of  computer-communications  networks. 
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2.0  THE  BASIC  MODEL 

The  model  introduced  in  Jackson  (1957)  la  a generalization  of  the 
classical  M/^/s  queue  to  an  arbitrarily  interconnected  open  network  of 
server  nodes  with  exponential  service  and  Poisson  external  input.  Specific- 
ally, there  are  N nodes  with  node  i having  s^  servers,  a first-come- 
first-served  queue  discipline,  and  a waiting  room  of  unlimited  capacity. 

The  external  input  stream  to  node  i is  Poisson  with  rate  , and  these 
external  input  streams  are  assumed  to  be  independent.  The  service  times  at 
node  i are  independent  and  have  a common  exponential  distribution  with 
parameter  , and  are  also  independent  of  the  customer  arrivals  at  node 
i . A customer  leaving  node  i is  immediately  and  independently  routed 

to  node  j with  probability  p^^  ; and  the  customer  departs  the  system  from 

N 

node  i with  probability  ‘I-  = 2 P-i4  • Observe  that  this  model  is  quite 

^ j=l  ^ 

general,  encompassing  such  systems  as  a finite  number  of  M/^/s  queues  in 
tandem,  an  acyclic  network  of  M/m/s  queues,  or  a network  of  H/h/s  queues 
with  feedback. 

In  Jackson  (1957)  bhe  state  of  the  network  at  time  t is  taken  to  be 


C(t)  s |c|^(t),  C2(t),  . . . , Cjj(t)j 


where  c^(t)  is  the  number  of  customers  at  node  i at  time  t , including 
any  customers  in  service.  The  state  space  of  Cc(t),  t > O)  is  the 

countably  infinite  set  of  all  N-tuples  of  non-negative  Integers . Given  the 
independent  Poisson  external  input  streams,  the  exponential  service  times  at 
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Che  various  nodes,  and  Che  IndependenC  roucing  scheme,  Ic  follows  readily 
chac  (c(c),  c > O)  is  a Markov  process  wich  scacionary  cransicion  proba- 
bllicies . 

In  (lli)  Jackson  proved  Che  remarkable  resale  chac  whenever  an  equilibrium 
condiCion  exisCs.  each  node  in  che  neCwork  behaves  as  if  ic  were  an  IndependenC 
M/M/s  queue  wich  Poisson  inpuC.  Specifically  lec  \ = (\.,  \^,  . . . , \ ) 
be  Che  row  vecCor  of  exCemal  inpuC  inCensicies,  lec  P be  Che  N x N macrix  of 
Che  ^ ‘ > '^)  vecCor  soluClon  of 

Che  craffic  equacion  (cf.  [31) 

a = \ + crP  . (2) 

Since  we  are  assuming  che  neCwork  is  open,  chaC  is,  any  cusComer  in  any  queue 

evencually  leaves  Che  sysCem,  iC  follows  chac  each  enCry  of  Che  raacrix  p" 

» 

converges  Co  0 as  n ->  <»  . Thus,  che  maCrix  I - P is  Invercible,  and  che 

equation  (2)  has  a unique  solution  for  a given  \ . InCuiCively,  che  Craffic 

equacion  is  a balance  or  conservation  equacion  in  which  is  interpreted  as 

che  total  average  arrival  rate  Co  node  1 under  equilibrium  conditions.  And, 
ic  is  plausible  chat  equilibrium  conditions  will  obtain  if  che  "Craffic 
intensity"  is  less  than  one  at  each  node,  i.e., 

Oi  ■ '^i/*i'^i  ^ ^ (5) 

for  ial,2,  ...,N  . Under  these  assumptions,  Jackson  showed  Chat  if 

7r(C)  is  Che  equilibrium  probability  of  che  network  being  in  state 
C*  ^^1*  ^2^  * " ***N^  * than 

7t(C)  - 
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where  equilibrium  probability  of  having  customers  in 

an  M/M/s  ^ queue  with  input  rate  and  service  rate  for  each  server. 

The  particular  product  form  of  the  right  side  of  (Ia)  reveals  the  independence 
of  the  various  nodes  in  the  network  under  equilibrium  conditions.  That  is  to 
say,  if  C(0)  is  given  the  distribution  (!^),  then  C(t)  has  distribution 
(h)  for  each  t > 0 , and  so  the  numbers  of  customers  at  the  various  nodes 

at  each  time  point  are  independent  random  variables.  In  Figure  1 below  we 
depict  the  structure  of  a typical  node,  say  node  i , under  equilibrium  con- 
ditions . 
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From  Figure  1 we  see  that 


Eh  - E hh  - 


(5) 


U1 


1=1 


that  Is,  under  equilibrium  conditions,  the  total  external  input  flow  rate  to 

the  network  must  equal  the  total  external  departure  flow  rate.  The  equation 

(5)  can  be  readily  obtained  from  the  traffic  equation  (2). 

We  now  proceed  to  outline  a proof  of  (^i).  In  so  doing,  we  employ  an 

argument  which  uses  the  technique  of  partial  balance  and  which  is  fundamental 

to  much  of  the  equilibrium  analysis  of  networks  of  queues.  To  keep  notational 

complexity  to  a minimum,  we  will  assume  in  the  upcoming  sub-section  that  each 

node  consists  of  a single  server.  Then,  in  the  notation  of  (^4-), 

c. 

= (1  - for  i = 1,  2,  . . . , N 

2.1  The  Equilibrium  Distribution  and  Partial  Balance 

As  will  be  observed  later,  the  continuous  time  Markov  chain 
[c(t),  t > O)  is  irreducible  and  "well-behaved."  Let  q(C)  denote  the  total 
transition  rate  out  of  state  C and  q(C,  D)  the  transition  rate  from  state 
C to  state  D for  D ^ C . In  view  of  (3),  for  7t(C)  defined  by  (!»•)  we 

have 


E"«:) 


(«) 


Thus  (7r(C),  Ce^)  is  the  equilibrium  or  limiting  distribution  of 
{C(t),  t > 0)  if  and  only  if 
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(T) 


7r(c)q(c)  = 7r(D)  q (D,C) 

D*G 

for  all  states  C in  'if  . The  equation  (7)  is  a "balance  relation"  equating 
the  equilibr.iuni  rate  of  flow  out  of  state  C with  the  equilibrium  rate  of 
flow  into  state  C . Granting  that  one  has  been  sufficiently  astute  to  guess 
the  correct  form  of  the  equilibrium  probabilities,  verifying  that  the  proba- 
bilities in  (li)  do  satisfy  (7)  is  not  entirely  trivial.  Moreover,  as  model 
complexity  increases,  the  direct  verification  that  a given  set  of  probabilities 
satisfies  the  balance  equation  (7)  becomes  extremely  difficult.  Fortunately, 
however,  the  method  of  partial  balance  introduced  in  Whittle  (1967,  I968)  pro- 
vides a simple  means  for  getting  around  this  impasse  in  many  (but  not  all)  cases. 
In  this  approach,  one  attempts  to  decompose  the  balance  equation  (7)  into  smaller 
sets  of  "partial  balance  equations"  and  then  show  that  the  distributicn 
(7t(C),  Ce*^}  satisfies  these  simpler  equations.  For  the  first  such  equation 
we  might  balance  the  rate  at  which  the  system  leaves  state  C due  to  external 
arrivals  with  the  rate  at  which  the  system  enters  state  C due  to  external 
departures.  For  the  second  such  equation,  we  might  balance  the  rate  of  system 
transition  out  of  state  C due  to  service  completion  with  the  rate  of  transi- 
tion into  state  C due  to  external  arrivals  or  internal  transfers.  We  might 
also  try  to  decompose  one  or  both  of  the  above  partial  balance  equations  into 
yet  simpler  balance  relations.  For  exanqile,  with  regard  to  the  second  of  the 
proposed  partial  balance  equations,  we  might,  for  each  node  i , equate  the 
rate  of  flow  out  of  state  C due  to  the  departure  of  a customer  from  node  i 
with  the  rate  of  flow  into  the  state  C due  to  the  arrival  of  a customer  at 


r 


f 


) 


* 


I 


» 


» 


node  1 . It  Is  important  to  note  that  for  any  given  model  one  has  no 

assurance  *a  priori  that  a set  of  partial  balance  equations  is  consistent; 
cf.  [2].  But,  it  is  clear  that  any  solution  of  a set  of  partial  balance 
equations  will  indeed  satisfy  (7)> 

To  develop  partial  balance  equations  for  the  model  of  Jackson  (1957) 
with  single-server  nodes  we  introduce  some  additional  notation.  For 
1 < i < N let  denote  the  M-vector  with  all  components  zero  except  for 

1 in  component  i . If  C(t)  = C , then  the  next  transition  will  be  either 
to  state  C + E^  (external  arrival  at  node  i ),  to  state  C - E^  (external 
departure  from  node  i ),  or  to  state  C-E^  + E^  for  i*  j (transfer  from 
node  i to  node  j ) . Thus,  for  state  C we  should  have 


q(C)  q(C,  C+E^)  q(C,  C -E^) 

i-1  i=l 

N N 

+ q(C,C-E^  + Ej) 

i=l  J=1 


(8) 


where  q(C,C')  = 0 if  C*  is  not  in  . We  will  ass^nae  that  equation  (8) 

indeed  holds  for  all  states  C . Then,  the  first  partial  balance  equation 
suggested  above  is 


or 


N 

7r(C)^q(C,  C+E^) 
i-1 


N 

7r(C  + Ei)  q (C  + E^,  C) 
i-1 


ial 


(9) 
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The  second  suggested  partial  balance  equation  mighty  as  proposed  above, 
be  decomposed  on  a node^by-node  basis  into 


7r(c)  q (C,  C -E^)  + 7r(C)^  q(C,  C+  - E^)  = 


7r(C -E^,  C)q  (C -Ej,,  C)  +y^7r(G  + E.  -E^)q(C  + Ej  -E^,C) 


for  1 = 1,  2,  ...  N,  or 


N 

7r(C)  q^Ui 

J=1 


il 

7T(C-E^)Xj_  + 7r(C-4-E,  -E^)  p. 


for  1 a 1,  2,  . . . , N , where,  for  ease  of  notation,  we  have  assumed  In  (.10) 
that  each  component  of  G is  non-zero.  In  view  of  (2),  (5)  and  (5),  it  is 
easy  to  check  that  {7t(g),  C € *<? } as  defined  by  (k)  satisfies  (9)  and  (10), 
and  hence  satisfies  (7)>  lb  follows  Innediately  from  (d)  that 


N « H 


for  all  states  C . Thus,  the  process  CG(t),  t>0)  has  no  absorbing  states 
and  has  only  finitely  many  transitions  in  any  finite  time  interval  with 
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probability  one.  Since  any  customer  in  any  queue  eventually  leaves  the  system, 
then  starting  from  any  state  in  it  is  possible  by  a series  of  transitions 
to  reach  the  state  (0,0,  . . . , O)  . Hence,  the  process  (C(t),  t>0)  is 
also  irreducible.  The  proof  of  (U)  is  now  complete. 


2.2  Departure  Processes  and  Time  Reversal 

In  addition  to  the  "product  form"  of  the  equilibrium  queue-lengths 
distribution,  the  other  main  equilibrium  result  for  open  Markovian  networks 
of  queues  is  concerned  with  the  process  of  external  departures.  As  remarked 
earlier,  this  equilibrium  departure  process  consists  of  independent  Poisson 
streams.  In  order  to  illustrate  the  result,  let  us  once  again  consider  the 
model  of  Jackson  (1957)* 

By  a result  of  Burke  (1956)  and  Reich  (195T)>  we  know  that  the  output 
of  an  n/ti/a  queue  in  equilibrium  is  Poisson  with  the  same  intensity  as  the 
input  process.  From  (U)  we  know  that  the  queue -length  processes  at  the  various 
nodes  are  independent  in  equilibrium,  and  that  node  i behaves  as  a M/^/s^ 
queue  with  input  rate  . Moreover,  a customer  leaving  node  i exits  the 

system  with  probability  q^  . Thus,  it  is  plausible  that  in  equilibrium  the 
external  departure  streams  are  independent  Poisson  processes . the  rate  at  node 


1 being  ; cf.[U]  or  (191  • To  verify  this  we  outline  an  argument  using 

time  reversal. 

The  choice  of  the  origin  on  the  time  axis  as  the  starting  point  for  the 
equilibrium  queue-lengths  process  is  entirely  arbitrary.  If  we  give  C(0) 
the  distribution  defined  by  (U)  then  the  equilibrium  process  fc(t),  0<t<oo) 
can  be  regarded  as  the  continuation  of  a process  in  equilibrium  that  has  already 


been  going  on  an  infinite  length  of  time.  To  see  why  this  is  so^  first  note 


that  for  t'  in  (-«>,0)  we  can  define  the  equilibrium  process  over  [t',  oo) 
by  simply  moving  the  starting  point  from  0 back  to  t*  . Letting  t'  tend 
to  >00  then  gives  rise  to  a consistent  family  of  finite  dimensional  distri- 
butions (cf.  [5])  which  enables  one  to  construct  an  equilibrium  queue-lengths 
process  defined  over  all  times  t in  ( - 00,  00)  . The  process  {C(t),  - » <t<oo) 

so  obtained  is  a Markov  chain  in  equilibrium  with  distribution  given  by  (U). 
Moreover,  the  reversed  process  (c(-t),  - » <t<(»)  is  also  a Markov  chain  in 
equilibrium  with  the  same  distribution,  the  transition  rates  q'(C)  , 
q'(C, D)  for  the  reversed  process  being  given  by  (cf.  [18]  and  [52]) 

7r(C)q(C,D)  = 7T(D)q'(D,C)  ■ (11) 


and 


q'(C)  = q(C)  . (12) 

Now,  using  (11)  and  (12)  it  is  not  difficult  to  check  (cf.  [I9])  that  the 
reversed  process  is  also  an  open  Markovian  network  of  queues.  Observe  that 
external  arrivals  for  the  reversed  process  correspond  to  external  departures 
for  the  original  process.  Hence,  external  departures  from  node  i in  the 
original  process  are  Poisson  with  rate  <■  , and  these  external  depar- 

ture processes  are  Independent  for  the  various  nodes.  Also,  since  past  depar- 
tures from  the  system  in  the  original  process  correspond  to  future  external 
arrivals  in  the  reversed  process,  the  current  state  of  the  system  in  the 
original  process  is  independent  of  past  departures  from  the  system. 
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2.5  Other  Class  leal  Work  on  Equilibrium  Analysts 


In  contrast  to  the  open  network  of  queues  Introduced  In  Jackson 
(1957)>  Gordon  and  Newell  (I96T)  considered  a closed  Markovian  network  in 
which  a fixed  and  finite  number  of  customers^  say  M , circulate  through 
the  network  and  no  external  arrivals  or  departures  are  permitted.  This 
corresponds  to  Jackson's  model  in  which  = 0 and  q^  3 0 for  each  i 
As  before,  the  state  of  the  system  is  taken  to  be  the  numbers  of  customers 
at  the  various  nodes.  In  this  model,  the  state  space  is  the  finite  set 


of  all  N-tuples  C = (c^,  c^,  . . . , c^^)  of  non-negative  integers  such  that 


c^  + Cg  + 


^c^  = M 


(15) 


The  traffic  equation  now  becomes 


a 


aP 


and,  assuming  P is  irreducible,  we  can  regard  a as  the  unique  stationary 
distribution  of  the  discrete  parameter  Markov  chain  with  transition  matrix 
P . Thus,  for  this  model  the  process  (c(t),  t > O]  is  an  irreducible  con- 
tinuous time  Markov  chain  with  finite  state  space,  and  hence  possesses  a 
limiting  or  equilibrium  distribution.  Let  3^  3 , let 


ti(ci) 


If  S ®i  X 


and 


(11*) 


if  > s^  , 
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1 


for  ...,N  , and  put 


N 

V 1 

Then,  the  result  of  Gordon  and  Newell  is  that  7r(c^,  Cg,  . . . , c^)  , the 

equilibrium  probability  of  having  customers  at  node  1 , Cg  customers 

at  node  2 , and  so  on,  is  given  by 

N 

7t(c^,  Cg,  . . . , c^)  = B 

1 


Thus,  the  equilibrium  distribution  has  a product  form,  though  the  behavior  at  the 
various  nodes  can  no  longer  be  regarded  as  independent  since  (c^,  Cg  . . . , c^) 
must  satisfy  (15)*  Observe  that  in  this  closed  system  the  quantity 
can  be  regarded  as  the  "relative  utilization"  of  node  i . The  result  of  Gordon 
and  Newell  can  be  derived  using  the  technique  of  partial  balance. 

In  [15]  Jackson  considered  a more  general  open  Markovian  queueing  system 
which  also  includes  the  model  of  Gordon  and  Newell  as  a special  case.  In  the 
model  of  Jackson  (I963)  the  customer  arrival  process  is  allowed  to  depend  upon 
the  total  number  of  customers  in  the  system  and  the  service  rate  at  any  node 
is  allowed  to  be  a f\mctlon  of  the  number  of  customers  at  the  node.  In  CI3] 
Jackson  provided  sufficient  conditions  for  the  existence  of  a unique  equilibrium 
distribution  for  the  process  (c(t),  t > O)  and  showed  that  this  equilibrium 
distribution  is  of  the  form  (1). 
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In  the  closed  Msrkovlan  system  of  Gordon  and  Nevrell  (196?)  was 

generalised  to  allow  different  types  of  customers,  with  a different  set  of 
transition  probabilities  and  service  rates  for  each  type.  In  addition,  travel 
times  between  various  nodes,  instead  of  being  taken  as  instantaneous,  were 
permitted  to  have  arbitrary  distributions.  Once  again,  it  was  demonstrated 
that  the  equilibrium  distribution  for  the  numbers  of  customers  at  the  various 
nodes  (and  in  transit)  is  of  product  form. 

2.U  Limitations  of  Classical  Work 

The  classical  results  on  the  equilibrium  analysis  of  networks  of 
queues  have  a number  of  limitations,  including  the  following: 

1.  All  service  time  distributions  in  the  network  are  exponential. 

2.  For  open  systems,  sufficient  conditions  are  provided  for  the 
existence  of  equilibrium  distributions,  but  these  conditions 
are  not  shown  to  be  necessary. 

3.  Customer-oriented  measures  of  system  performance  such  as  total 
waiting  time  and  total  response  time  (waiting -plus -service 
time)  experienced  by  an  arbitrary  customer  have  bean  largely 
ignored.  The  problems  of  response  time  and  waiting  time  for  a 
finite  number  of  Markovian  queues  in  tandem  are  extensively 
examined  by  Raich  in  [37l»  [36]  and  [39l. 

U.  In  the  work  of  Jackson  (1957»1963)  the  work  of  Gordon  and 
Newell  (1967),  all  customer  behavior  is  similar  in  the  sense 
that  at  each  node  service  times  and  transition  probabilities 
are  drawn  from  the  same  distribution  and  the  queue  discipline 
at  each  node  is  first-come-flrst  served.  Different  customer 


types  are  not  permitted.  Different  customer  types  are  allowed, 
however,  in  the  closed  system  of  Posner  and  Berhnoltz  (I968). 

5.  A less  serious  (though  not  unimportant)  limitation  is  the 

assumption  of  instantaneous  travel  times  between  nodes . This 
restriction  is  also  removed  for  closed  Markovian  networks  in 
(361. 

As  will  be  seen  In  the  upcoming  sections  of  this  paper,  recent  efforts 
In  networks  of  queues  remove  some  of  these  limitations.  But,  we  shall  find 
that  a number  of  Important  problems  remain  unsolved. 
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5.0  THE  BASIC  MODEL  REVISITED 
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An  inCerestlng  study  of  the  classical  queueing  network  model  of  Jackson 
(1957)  with  single-server  nodes  has  recently  been  put  forth  in  (31,  (l^-l,  l50l, 
and  [31].  A noteworthy  aspect  of  these  papers  is  the  emphasis  placed  on 
understanding  the  behavior  and  structure  of  the  most  fundamental  model  in  the 
area  of  networks  of  queues . For  purposes  of  information  we  remark  that  the 
results  of  [3],  (^1,  and  (3II  are  included  in  (50]. 

In  this  work  a careful  description  of  the  network  is  provided  and  a 
careful  formulation  of  the  problem  is  presented.  Open  systems,  closed  systems, 
and  mixed  systems,  i.e.,  systems  which  are  neither  open  nor  closed,  are  con- 
sidered. An  exhaustive  study  of  the  traffic  equation  is  provided,  followed 
by  a thorough  analysis  of  various  aspects  of  system  behavior  under  equilibrium 
conditions,  including  queue-length  processes,  departure  processes  and  traffic 
processes  on  arcs.  Also,  the  total  service  time  received  by  an  arbitrary 
customer  is  discussed.  Some  gaps  in  the  extant  theory  for  the  model  of  Jackson 
(1-957)  are  closed.  In  particular,  for  an  open  network  with  single-server  nodes, 
the  condition  (3),  i.e.,  each  node  1 , is  shown  to  be  necessary 

for  the  existence  of  an  equilibrium  distribution  (see  (30]);  also,  as  remarked 
earlier,  the  classical  results  for  departure  processes  in  M/^/s  queues  are 
extended  to  the  network  case  for  single-server  nodes  in  [L].  Applications  to 
equilibrium  decompositions  of  the  network  are  given.  The  results  obtained  are 
used  to  exhibit  some  structural  simplifications  that  take  "Jackson  networks" 
into  "Jackson  networks,"  while  preserving  a variety  of  operating  characteristics. 
Simulation  complexities  of  "Jackson  networks"  are.  also  discussed.  Many  of  the 
results  in  [3],  [U]  and  [30]  are  obtained  by  proceeding  from  the  Kolomogoroff  forward 
equation  for  an  appropriate  Markov  Jump  process,  while  the  results  of  [31],  and 
many  of  the  results  in  [30],'are  system-theoretic  in  nature. 
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For  Che  basic  model  with  single-server  nodes,  let  T and  S denote, 
respectively,  Che  total  time  spent  in  the  system  and  Che  total  service  time 
received  by  an  arbitrary  customer  when  the  system  is  in  equilibrium,  that  is, 
when  Che  distribution  of  the  queue- lengths  vector  C(c)  is  given  by  (1;)  for 
all  times  C in  (•ao,oa)  . The  Laplace  transform  of  Che  distribution  of 
S is  derived  in  Combining  the  thrust  of  the  argument  for  this  service 

time  result  in  [3]  with  a result  in  [h]  concerning  traffic  processes  on  arcs, 
we  now  derive  the  Laplace  transform  of  T for  the  important  case  of  an 
"acyclic  network.”  that  is,  an  open  network  with  "switching  matrix"  P such  that 
a customer  can  never  visit  any  node  more  than  once.  In  Che  terminology  of  [U], 
each  arc  of  the  network  is  an  "exit  arc." 

For  an  arbitrary  customer  entering  the  system  at  node  i , let 
denote  Che  total  time  the  customer  is  in  the  network.  Let  g^  denote  Che 
Laplace  transform  of  the  distribution  of  for  i=l,2,  ...,N  . For 

all  c Che  queue-length  distribution  at  node  i coincides  with  that  of  an 
M/m/1  queue  in  equilibrium  with  traffic  intensity  0^  . So,  a customer 
entering  the  system  at  node  i remains  at  node  i for  a random  time  whose 
distribution  has  Laplace  transform  h^  where 


i' 

I. 


for  u > 0 with  ■ |ij^(l  - 0^^)  . After  being  served  at  node  1 , the 

customer  either  leaves  the  network  (with  probability  q^  ) or  is  transferred  r 

to  some  node  J ^ i (with  probability  p^^  ) . Conditioned  on  this  latter  ,, 

event,  Che  customer's  total  residual  sojourn  time  in  the  network  has  the  same 
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distribution  as  and  Is  Independent  of  the  time  spent  ac  1 , the  node 

of  entry.  To  support  this  contention,  we  argue  as  follows.  Let  and 

, denote,  respectively,  the  number  of  customers  at  node  1 and  node  j 
the  Instant  after  our  customer  has  completed  his  service  at  node  1 . By 
Theorem  3*3  In  [^],  the  traffic  processes  on  the  various  arcs  of  the  network 
are  Independent  Poisson  processes,  the  rate  on  arc  (k,  k')  being 
Thus,  the  processes  which  measure  the  total  stream  of  arrivals  (both  external 
and  Internal  transfers)  to  the  various  nodes  over  finite  time  Intervals  are 
Independent  Poisson  processes,  the  rate  at  node  k being  . In  view  of 

this,  the  argument  for  Theorem  5 in  (38)  shows  that  the  variables  and 

are  Independent,  conditioned  on  the  transfer  from  1 to  j . Thus,  our 
customer's  sojourn  time  at  node  1 Is  Independent  of  the  queue-size  distri- 
bution at.  node  j upon  his  arrival,  and  therefore  Independent  of  his  total 
residual  sojourn  time  In  the  network.  Moreover,  this  total  residual  sojourn 
time  has  the  same  distribution  as  T^  . Therefore,  we  can  write 


'•  i 


• hj^(u) 


(17) 


for  1 a 1,  2,  . . . , N . Substituting  the  above  expression  for  h^  Into 
(17)  gives 


C(v^  + u)/vJ  • gj^(u)  » Pj^jgj(u) 

J 


(18) 


From  here  on  we  esq>loy  a sliqpllfled  version  of  the  arguments  used  In  Section 
V of  [31  to  derive  the  Laplace  transform  of  the  distribution  of  S . Let  g(u) 
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be  a column  vector  whose  1th  component  is  g^(u), q of  a column  vector 
whose  ith  component  is  , D(u)  a diagonal  matrix  whose  ith  diagonal 

entry  is  (v^  + u)/v^  , and  let  G(u)  = D(u)  - P . Then,  equation  (18)  is 


equivalent  to 


G(u)g(u)  = q 


The  matrix  D(u)  is  clearly  invertible  for  any  u > 0 , and  so  we  can  write 


G(u)  = - P[D(u)]'^)d(u)  . 


Since  each  diagonal  element  of  the  diagonal  matrix  [D(u)]  is  in  (0,  1], 
it  follows  from  (20)  that  G(u)  is  invertible  for  any  u > 0 . An  arbitrary 

customer  enters  the  system  via  node  i with  probability  Xg  + • • • + X^) 

Let  X denote  the  row  vector  of  these  node-entry  probabilities.  Then,  letting 
h denote  the  Laplace  transform  of  the  distribution  of  T , we  therefore  have 

h(u)  = x[G(u)]‘^q  (21) 


for  u > 0 . It  follows  from  (19)  that  each  transform  g^  is  a rational 
function  (whose  denominator  is  a polynomial  in  u of  degree  at  most  N ) . Hence, 
h(u)  is  the  transform  of  a mixture  of  exponential  distributions.. 

Having  derived  the  Laplace  transform  of  the  distribution  of  T , let  us 
now  compute  E{t}  . Since  any  customer  never  visits  a node  more  than  once  and 
each  node  functions  as  a H/n/l  queue  in  equilibrium,  it  is  clear  that  E{T} 
is  finite.  Thus 
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eCt)  = - lim  h'(u) 

u -»0 

where  prime  denotes  derivative  with  respect  to  u . From  (I9)  we  have 


g'(u)  = - [g(u)]"^  G'(u)  g(u) 


(22) 


for  all  u > 0 . The  matrix  G'(u)  is  simply  the  diagonal  matrix  whose  1th 
diagonal  entry  is  > and  as  u -♦  0 the  vector  g(u)  tends  to  the 

colunn  vector  of  I's  . From  (20)  we  have 


[g(u)]'^  " S 
n=0 


(25) 


Since  each  element  of  the  diagonal  matrix  [D(u)l  ^ is  in  (0,1]  and  [B(u)] 
tends  to  the  identity  matrix  as  u -»  0 , it  follows  readily  from  (23)  that 
[G(u)]  ^ tends  to  (l  -P)  ^ as  u -*  0 . Combining  all  of  the  above  with  the 
fact  that  a = X(l  " P)  ^ , we  find  that 


(21^) 


For  the  case  of  a finite  number  of  slngle-seirver  Markovian  queues  in  tandem, 
the  results  (21)  and  (24)  reduce  to  those  obtained  by  Reich  in  [38I.  Replacing 
Vi  by  in  (18)  yields  the  Laplace  transform  (and  the  first  moment)  of  the 

distribution  of  S , the  total  amount  of  service  received  by  an  arbitrary 
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customer  in  an  open  network;  see  Section  V of  [3],  Thus,  if  we  denote  by 
W the  total  waiting  time  (exclusive  of  service  time)  experienced  by  an 


I 


» 


arbitrary  customer,  i.e.,  W=T-S  , then  for  an  open  "acyclic  netxrork" 
we  have 


(25) 


t 


I 


f 


t 


9 
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3.1  Some  Generalizations  of  Jackson  (1957)  and  Gordon  and  Newell  (196?) 

In  Kelly  (1975)  the  classical  Markovian  queueing  network  models  of 
Jackson  (1957)  Gordon  and  Newell  (I967)  are  generalized  to  networks  of 
queues  with  different  classes  of  server  nodes  and  different  types  of  customers 
while  retaining  the  assumption  that  all  service  times  are  exponentially  dis- 
tributed and  all  external  input  processes  are  Poisson.  In  the  model  of  Kelly 
(1975)  each  node  has  a single  server,  but  by  varying  the  service  rate  according 
to  the  number  of  customers  in  the  node  the  node  may  function  as  a queue  with 
one  server,  many  servers  (including  an  infinite  number),  or  as  a queue  where 
the  server  works  at  a fixed  rate  but  shares  his  effort  equally  among  all 
customers  present  in  the  node  (this  being  the  "processor-sharing"  discipline 
often  appearing  in  the  literature  on  computer  time-sharing  and  multiprogramming 
systems).  Also,  when  the  maximum  service  rate  is  fixed,  the  allowable  queue 
disciplines  Include  first-come-first-served  and  preemptive-resume  last-come-first- 
served.  For  both  the  closed  system  and  the  open  system,  equilibrium  distribu- 
tions are  obtained  for  the  numbers  of  customers  at  the  various  nodes,  including 
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the  arrangement  of  customer  types  within  queues.  The  service  time  distribu- 
tions are  the  same  for  all  customers  at  a given  node.  These  equilibrium 
distributions  have  a product  form,  generalizing  what  was  observed  for  the 
classical  models;  and,  for  open  systems,  the  various  nodes  are  shown  to  be 
independent  in  equilibrium.  The  equilibrium  distributions  in  Kelly  (1975) 
are  obtained  using  the  method  of  partial  balance.  In  addition,  for  the  open 
system  the  departure  processes  in  equilibrium  of  the  various  customer  types  from 
the  different  queues  are  shown  to  be  independent  Poisson  streams;  and,  the 
present  state  of  the  process  in  equilibrium  is  shown  to  be  independent  of  past 
departures  from  the  system.  These  departure  results  are  derived  using  time 
reversal. 

The  most  general  equilibrium  results  for  extensions  of  the  classical 
models  of  Jackson  (1957)  and  Gordon  and  Newell  (I967)  have  been  obtained  by 
Baskett  et  al  (1975)  and  Reiser  and  Kobayashi  (1975)*  These  authors  allow  a 
variety  of  customer  types  and  different  kinds  of  server  nodes  in  order  to  model 
central  processors,  data  channels,  terminals,  and  routing  delays  in  computer 
systems.  The  allowable  queue  disciplines  associated  with  the  server  nodes  are 
flrst-come-first-served,  processor  sharing,  no  queueing  (infinite  number  of 
servers),  and  preemptive-resume  last-come-flrst-served.  Each  customer  belongs 
to  a single  type  while  awaiting  or  receiving  service,  but  may  change  type  and 
node  at  the  completion  of  a service  request.  State  dependent  arrival  processes 
are  allowed  for  open  netxrarks.  The  network  may  be  closed  for  some  customer 
t3rpes  and  open  with  respect  to  other  customer  types.  If  a node  operates  on  a 
first-come-first-served  basis,  then  the  service  time  distribution  is  exponential 
and  the  same  for  all  customer  types,  but  the  service  rate  may  be  state  dependent. 


At  server  nodes  with  other  queue  disciplines,  service  time  distributions  with 
rational  Laplace  transforms  are  permitted,  with  a different  distribution  for 
each  type  of  customer.  Using  the  method  of  partial  balance,  the  equilibrium 
state  probabilities,  when  they  exist,  are  shoxm  to  have  the  general  form  (1). 

In  the  particular  case  where  the  network  is  open  and  the  arrival  processes 
do  not  depend  on  the  state  of  the  system,  the  following  interesting  result  is 
obtained  in  [2].  If  the  queue  discipline  at  node  1 is  flrst-come-first-served, 
or  process or -sharing,  or  preemptive-resume  last-come-first-served,  then  the 
equilibrium  distribution  of  the  total  number  of  customers  present  at  node  1 
coincides  with  that  of  a M/^/l  system  with  an  appropriate  traffic  intensity 
. If  node  i has  an  infinite  number  of  servers,  then  the  equilibrium 
distribution  of  the  total  number  of  busy  servers  coincides  with  that  of  a 
M/g/oo  system  with  an  appropriate  mean  number  of  busy  servers.  Moreover,  the 
various  nodes  are  independent  in  equilibrium. 
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h.O  THE  PAPERS  OF  KELLY  (1976)  AND  BARBOUR  (1976) 

In  Kelly  (1976),  the  results  of  Jackson  (1957,  1965)  for  open  systems 
are  expanded  particularly  with  regard  to  routing  behavior.  Customers  of 
different  types  are  permitted  along  with  a variety  of  routing  schemes  and 
queue  disciplines . Customers  of  type  m , l<m<M  , enter  a system  of 
queues  i , l<i<N  ,ina  Poisson  stream  of  rate  , the  separate 

streams  being  independent,  and  proceed  through  the  fixed  sequence  of  queues 
r(m,  1)  , . . . , r(m,  L(m))  before  leaving  the  system.  Hence,  a customer 
of  type  m at  stage  i (1  < £ < L(m))  along  his  route  will  be  at  node  r(m,  i)  . 

Each  customer  type  is  thus  allowed  to  have  a different  route  through  the  system. 

This  permits,  for  example,  a routing  scheme  whereby  a customer  visits  each  node 
exactly  once,  but  in  random  order,  before  leaving  the  system;  one  can  do  this 
by  having  a separate  customer  type  for  each  possible  route.  One  can  also  have 
a routing  scheme  where  each  customer  type  visits  some  queue(s)  exactly  twice. 

More  importantly,  however,  allowing  fixed  routes  by  customer  type  makes  the 
model  of  Kelly  (1976)  well  suited  for  communications  applications.  To  continue 
with  the  model  description,  it  is  first  assumed  in  [20]  that  at  each  node  a customer 
requires  an  amount  of  service  which  is  exponentially  distributed.  However, 
state-dependent  service  and  arrival  rates  are  allowed.  The  state  of  the  sys- 
tem includes  (for  each  node)  the  types  of  customers  present  and  their  positions 
in  the  queue,  as  well  as  the  stage  along  his  route  that  each  customer  has  reached. 

The  equilibrium  state  probabilities,  when  they  exist,  are  shown  to  be  of  product 
form,  with  the  state  of  each  queue  being  independent  of  the  rest  of  the  system. 

Moreover,  in  equilibrium,  customers  of  type  m leave  the  system  in  a Poisson 
stream  of  rate  , and  the  departure  streams  for  the  various  customer  types 

are  Independent . ' 
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In  [20]  the  proof  that  the  equilibrium  state  probabilities  have  a product 
form  Is  accomplished  not  by  appealing  to  the  method  of  partial  balance  but  by 
clever  use  of  the  reversed  process,  l.e.,  time  reversal.  To  be  more  specific, 
let  {C(t),  0 < t < 00}  denote  the  Markov  process  describing  the  state  of  the 
system  In  [20]  and  suppose  the  transition  rates  of  (c(t),  0 < t < 00}  are 

q(C,  D)]  . Further,  suppose  we  believe  the  probability  distribution 

CttCc)]  is  the  equilibrium  distribution  of  (c(t),0<t<oo}  . This  can  be 

verified  as  follows.  We  first  guess  what  the  reversed  process  {c(-t),  -00  < t < ») 
might  be,  that  is  to  say,  we  guess  the  transition  rates  {q'(C),  q'(C,  D)}  for 
the  reversed  process.  If 


q'(C)  = ^ q'(c,  D) 

D*C 

for  each  possible  network  state  C , and  if  {rr(c))  , {q(C),  q(C,  D))  and 

fq^(C),  q'(C,  D))  together  satisfy  equations  (11)  and  (12),  then  Cc(t),  0 < t < « 
has  equilibrium  distribution  [7r(C)]  and  the  reversed  process  has  transition 
rates  (q'(C),  q'(C,  D)}  ; cf.  [20].  For  the  particular  model  of  Kelly  (1976), 

this  procedure  of  time  reversal  is  much  simpler  than  a direct  appeal  to  equation 
(7)  or  to  the  technique  of  partial  balance. 

With  the  same  formulation  of  customer  t3rpes  and  customer  routes  by  type, 
but  under  more  restrictive  assumptions  on  queue  discipline,  all  of  the  above 
results  in  [20]  are  then  generalized  in  [20]  to  the  case  where  service  times 
at  the  various  nodes  are  allowed  to  be  finite  mixtures  of  gamma  distributions. 

For  these  more  general  service  time  distributions,  the  permissible  queue  dis- 
ciplines Include  last-come-flrst-served,  no  qxieuelng,  and  processor-sharing. 


but  not  first-come-first-served.  The  equilibrium  state  probabilities  for 
this  model  have  a product  form,  and  the  departure  processes  in  equilibrium 
consist  of  independent  Poisson  streams.  These  results  for  more  general 
service  distributions  are  also  established  via  time  reversal  as  indicated 
above.  It  is  then  observed  that  the  product  form  for  the  equilibrium  distri- 
bution still  obtains  in  the  case  of  state -dependent  arrival  rates.  Since  the 
distribution  of  any  positive  random  variable  can  be  approximated  arbitrarily 
closely  by  a finite  mixture  of  gamma  distributions,  Kelly  conjectures  that 
his  result  holds  for  arbitrarily  distributed  service  times.  This  conjecture 
is  verified  in  Barbour  ( 197^ ) . 

The  particular  model  introduced  by  Kelly  (I976)  for  which  Barbour's 
result  is  obtained  is  as  follows.  As  mentioned  earlier,  customers  of  several 
types  enter  a finite  system  of  queues  in  independent  Poisson  streams,  with 
customers  of  type  m , say,  passing  through  the  fixed  sequence  of  queues 
r(m,  1)  , . . . , r(m,  L(m))  . Customers  within  each  queue  are  ordered,  and 

node  i operates  as  follows: 

(a)  A customer  of  type  m at  stage  I along  his  route,  with  r(m,  f)  » 1 , 
requires  a random  amount  of  service  R . with  finite  mean. 

QLC 

(b)  There  is  a single  server  at  node  i who  supplies  a total  service 

effort  at  rate  ^ ^ when  c^  is  the  number  of  customers  at  node  i 

(c)  A proportion  cp^(k,  c^^)  of  this  total  service  effort  is  directed 
to  the  customer  in  position  k (1  < k < c^) 

(d)  A customer  arriving  at  node  i moves  into  position  k with  proba- 
bility <pj^(k,  Cj^  + 1)  . 

(e)  The  service  requirements  • • • » ® type-m  customer 

have  a Joint  distribution  which  is  independent  of  the  state  of  the  network. 


- 27  - 


It  should  be  noted  that  use  of  the  same  function  cp^  in  (c)  and  (d) 
permits  such  queue  disciplines  as  processor-sharing,  no  queueing,  and  last- 
coToe-first-served,  see  [20],  but  not  first-come-first-served. 

Let  C(t)  = [c^(t),  C2(t),  . . . , Cjj(t)]  be  the  vector  of  queue-length 
processes  at  the  various  nodes  at  time  t > 0 . For  C = (c^^,  c^,  . . . , c^^ 
a possible  state  of  the  process  {c(t),  t > O)  , let 


P(C) 


nk/n- 


i=l 


(k) 


k=l 


(26 


where 


M L(m) 

m=l  1=1 


with  denoting  indicator  function.  Given  this  setup,  the  essence  of  the 

result  obtained  by  Barbour  in  [1]  is  as  follows.  Suppose  that 


p(c)  < 00  (28 

c 

and  that  for  each  m , l<m<M  , the  joint  distribution  F has  no  mass 

“ n 

at  zero  in  any  component,  l.e.,  all  service  times  for  each  customer  type  are 
strlckly  positive  with  probability  one.  Then,  for  each  state  C 


lim  P{c(t)  » C]  oe  p(c) 


(29 


Moreover,  in  equlllbriuot  the  various  customer  types  depart  the  system  in 

independent  Poisson  streams  with  rates  v, , . . . , . Barbour's  result 

i M 

is  achieved  by  proceeding  from  the  results  of  Kelly  (I976)  and  developing  a 
sophisticated  continuity  argument  involving  weak  convergence  results. 
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5.0  SOME  OPEN  PROBLEMS 


In  this  section  we  suggest  some  open  problems  in  the  equilibrium  analysis 
of  networks  of  queues.  If  one  compares  the  limitations  of  the  classical  work 
cited  in  Section  2 with  recent  work  reviewed  in  Sections  3 ^nd  then  it 
becomes  obvious  that  while  equilibrium  queue  distributions  have  been  obtained 
for  some  very  complex  networks,  there  are  significant  gaps  in  what  is  known 
about  important  aspects  of  the  equilibrium  behavior  of  some  quite  fundamental 
models.  Thus,  there  are  important  open  problems  which  merit  careful  study,  and 
we  will  now  discuss  some  of  these  problems  in  separate  numbered  paragraphs. 

1.  Let  us  begin  with  the  open  network  model  of  Jackson  (1937)  which 

each  node  consists  of  a single  server.  Consider  the  random  variable  T , the 
total  sojourn  time  in  the  system  for  an  arbitrary  customer,  which  was  discussed 
in  Section  2.  In  light  of  the  equilibrium  queue-lengths  distribution  (L),  it 
is  tempting  to  conjecture  that  the  transform  result  (21)  for  an  "acyclic  network" 
also  holds  for  a general  Markovian  open  network.  This  impulse  regarding  (21) 
is  tempered  somewhat  by  results  in  [30]  concerning  the  non-Poisson  character  of 
the  total  input  process  at  a node  i for  which  p^^  > 0 . Nonetheless,  it 

seems  plausible  that  (21)  should  extend  to  a general  open  network.  Reich 
observed  in  [391  that  for  two  M/^/l  queues  in  tandem  the  waiting  times  (times 
spent  in  queue  exclusive  of  service  times)  experienced  by  an  arbitrary  customer 
at  each  node  were  non-independent  random  variables.  Thus,  the  distribution  of 
the  total  waiting  time  in  an  open  queueing  network  experienced  by  an  arbitrary 
customer  is  probably  difficult  to  analyze.  For  the  basic  model  of  Jackson  (193T)> 
there  are  several  related  problems  posed  in  [30]  concerning  traffic  processes 
on  arcs . 
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2.  It  would  be  very  interesting  to  have  some  equilibrium  results  for  a 
network  of  m/g/1  queues,  that  is  to  say,  a queueing  network  model  of  the 
sort  Introduced  by  Jackson  (1957)  with  Poisson  external  input,  single-server 
nodes,  switching  matrix  P , a first -come -first  served  queue  discipline,  and 
arbitrarily  distributed  service  times.  More  general  service  time  distributions 
than  the  exponential  are  allowed  in  [2],  as  well  as  [1],  but  the  results  obtained 
are  for  queue  disciplines  other  than  first-come-first-served.  One  would  cer- 
tainly like  to  settle  the  question  here  of  whether  or  not  the  equilibrium  queue- 
lengths  distribution  has  a product  form,  and,  if  so,  whether  the  various  nodes 
function  as  M/g/1  queues  in  equilibrium  or,  as  in  the  open  network  model  of 
[2],  as  H/ti/l  queues  in  equilibrium. 

3.  Since  many  queueing  systems  encountered  in  practice  operate  just  below 
the  level  of  saturation,  it  would  be  helpful  to  have  "heavy-traffic”  results 
for  networks  of  queues  in  the  spirit  of  those  obtained  by  Kingman  (I963)  and 
Kollerstrom  (197^)  for  the  GI/g/I  and  GI/g/s  queues.  In  an  open  network, 
for  example,  one  could  allow  the  traffic  intensities  at  the  various  nodes  to 
approach  the  value  1 from  below  by  increasing  the  intensities  of  the  input 
streams  and  then  examine  the  as3nnptotlc  behavior  of  the  equlllbrlimi  sojourn 

time  distribution.  Some  results  in  this  direction  have  been  obtained  in  Harrison 
(1973)  for  a finite  number  of  GI/g/I  queues  in  tandem.  But  much  remains  to 
be  done. 
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